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Abstract 

In this paper the cognitive interference channel with a common message, a variation of the classical 
cognitive interference channel in which the cognitive message is decoded at both receivers, is studied. For 
this channel model new outer and inner bounds are developed as well as new capacity results for both 
the discrete memoryless and the Gaussian case. The outer bounds are derived using bounding techniques 
originally developed by Sato for the classical interference channel and Nair and El Gamal for the broadcast 
channel. A general inner bound is obtained combining rate-splitting, superposition coding and binning. 
Inner and outer bounds are shown to coincide in the "very strong interference" and the "primary decodes 
cognitive" regimes. The first regime consists of channels in which there is no loss of optimality in having 
both receivers decode both messages while in the latter regime interference pre-cancellation at the cognitive 
receiver achieves capacity. Capacity for the Gaussian channel is shown to within a constant additive gap 
and a constant multiplicative factor. 

1 Introduction of only the message to be transmitted to its in- 

tended receiver while the other encoder-the cognitive 

^ . T , transmitter- has knowledge of both messages. The 

Cognitive networks are transmission networks where , . , -, -i ui ^ ^ 

^ ^ ^ ^ ... additional knowledge available at the cognitive trans- 

the message of one user is known at multiple nodes. , i ^ -i -i ^ ui -i • u- u • 

, ^ . , • T T mitter models a smart and adaptable device which is 

The study oi cognitive networks was inspired by new- u i - • - 1 • r 

r -I- u u able to acquire the primary message from previous or 



simultaneous transmissions in the network. 



found abilities of smart radios to overhear the trans- 
mission taking place over the channel and gather in- 
formation about neighboring nodes [1 . The infor- The cognitive channel has been studied in depth 
mation theoretical study of cognitive networks has so in the last few years and many results have been de- 
far focused on small networks with a limited num- rived for this model. The largest known inner bound 
ber of users and messages. A classical such model is provided in [3 and is obtained using classical ran- 
is the cognitive interference channel [2]: a channel dom coding techniques such as rate-splitting, super- 
where two sets of transmitter /receiver pairs commu- position coding and binning. The most general outer 
nicate over a shared channel, thus interfering with bound is derived in [4 by using an argument origi- 
each others' transmission. One of the encoders in nally devised for the broadcast channel in [5 . Capac- 
the network-the primary transmitter- has knowledge ity for both the memoryless and the Gaussian case is 
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not known in general but only for specific subclasses. 
For the memoryless channel, the largest known re- 
gion where capacity is known is the "better cogni- 
tive decoding" regime, [6], where capacity is achieved 
by rate-splitting the cognitive message in a private 
and a public part and decoding the primary message 
at both receivers. This result generalizes two previ- 
ous results: a "very strong interference" result, [7 , 
and a "very weak interference" result, [8 . In the 
"very strong interference" regime there is no loss of 
optimality in having both receivers decode both mes- 
sages. This results is akin to the "very strong interfer- 
ence" result for the interference channel [9l [10] . For 
the "very weak interference" regime, instead, capac- 
ity is achieved by having the cognitive receiver decode 
the interference while the primary receiver treats the 
interference as noise. 

Capacity is also known for the semi-deterministic 
cognitive interference channel, that is for the 

channel in which the output at the cognitive receiver 
is a deterministic function of inputs while the output 
at the primary decoder is a any random function. 
Here capacity is achieved by having both cognitive 
and the primary message private and pre-coding for 
the cognitive transmission against the primary inter- 
ference. 

A larger set of capacity results is available for the 
Gaussian case than for the discrete memoryless case. 
Capacity is known in the "weak interference" regime 
[8], a regime that contains the "very weak interfer- 
ence" regime. As for the "very weak interference" 
regime, the optimal strategy for the primary receiver 
is to treat the interference as noise but, in this case, 
the cognitive codeword is pre-coded against the inter- 
ference created by the primary transmission. Capac- 
ity for the Gaussian case is also known in the "pri- 
mary decodes cognitive" regime of [12], in which the 
cognitive message is decoded at both receivers and 
pre-coded against the interference created by the pri- 
mary user at the cognitive decoder. It must be noted 
that a crucial tool to achieve capacity for both the 
deterministic and the Gaussian channel is interfer- 
ence pre-cancellation using binning as in the classical 
Gel'fand Pinsker problem [13 . For these two classes 
of channels binning at the cognitive transmitter can 
fully remove the effect of the interference experienced 



at the cognitive receiver. This property does not hold 
for a general channel and makes it easier to prove ca- 
pacity. 

Capacity for the Gaussian case is also known to 
within a constant additive gap of 1 bit/s/Hz and to 
within a multiplicative factor of two [11 . That is, 
the gap between the inner and the outer bound can 
be bounded by a constant difference as well as by 
a constant ratio. The first result well characterizes 
the capacity region in the high SNR regime while the 
latter gives a good capacity approximation for the 
low SNR regime. 

Despite of the difficulty in deriving capacity for 
the cognitive interference channel, capacity is fully 
known for a simple variation of the cognitive inter- 
ference channel: the cognitive interference channel 
with a degraded message set [M] . In this channel the 
cognitive receiver is required to decode both the cog- 
nitive and the primary message. The capacity achiev- 
ing strategy is have a public primary message and 
split the cognitive message in a public and a private 
parts. The cognitive public codeword is then super- 
posed over the primary public one and the private 
cognitive codewords over the two other public code- 
words. Since the primary message is decoded at both 
receivers, no interference pre-cancellation is required 
at the cognitive transmitter. 

Contributions 

In this paper we study the cognitive interference 
channel with a common cognitive message, a vari- 
ation of the cognitive interference channel where the 
primary receiver decodes both messages. We derive 
inner and outer bounds for this channel model as well 
as new capacity results. Some of the techniques used 
to derive these results are similar to the techniques 
used in m ini [12] for the cognitive interference chan- 
nel. In particular we highlight the relationship be- 
tween this channel model and the cognitive interfer- 
ence channel in the "strong interference" regime, a 
regime where there is no loss of generality in hav- 
ing the primary receiver to also decode the cognitive 
message. Capacity in this regime is known only in a 
subset of the parameter regime and progress in im- 
proving either inner or outer bounds has been slow. 
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We first derive a series of outer bounds, eacii con- 
taining an increasing number of auxiliary random 
variables. The simpler outer bounds are easy to eval- 
uate but are not tight in general while outer bounds 
with more auxiliary random variables are tighter but 
harder to evaluate and compare to inner bounds. 

We introduce an inner bound that employs rate- 
splitting, superposition coding and binning which is 
very much reminiscent of the achievable scheme in ^ . 
A compact representation of this achievable region is 
obtained by considering rate-sharing. Rate sharing 
consists in "shifting" rate contributions from the cog- 
nitive rates to the primary rates as well as from public 
rates to private rates. The Fourier Motzkin elimi- 
nation of the different rate contributions provides a 
more compact expression of the original achievable 
region. This techniques was introduced by Hajek 
and Pursley [15 when deriving an achievable region 
for the broadcast channel with common messages 
and successively employed when in [16 to derive an 
achievable region for the relay broadcast channel. 

Inner and outer bounds are shown to coincide 
for the general channel model in the "very strong 
interference" and the "primary decodes cognitive" 
regimes. The first regime is related to a result avail- 
able for the cognitive interference channel and we 
present it for completeness. The "primary decodes 
cognitive" regime, however, have not been investi- 
gated for the general cognitive interference channel so 
far. We also prove capacity for the semi-deterministic 
channel, that is the channel where the channel out- 
put at the cognitive decoder is a deterministic func- 
tion of the channel inputs while the output at the 
primary receiver is any random function. As for the 
cognitive interference channel, this result relies on the 
fact that for deterministic channels binning can com- 
pletely pre-cancel the interference experienced at the 
receiver. 

For the Gaussian case we prove capacity to within 
a constant additive gap of 1 bit/s/Hz and a multi- 
plicative factor 2. The proof for the constant addi- 
tive gap offers an alternative proof to the result in 
pT] although it does not improve on the overall gap. 

Most of the results we derive are shown using an in- 
teresting transmission scheme in which the cognitive 
message, decoded at both receivers, is also pre-coded 
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Figure 1: The Cognitive InterFerence Channel with 
Common Cognitive Message (CIFC-CCM). 



against the interference experienced at the cognitive 
decoder. The pre-coding of the cognitive message 
does not allow the primary decoder to reconstruct 
the interfering signal. The cognitive message acts in- 
stead as a side information at the primary receiver 
when decoding its intended message. The paper con- 
cludes with a set of numerical simulations that com- 
pare outer bounds, to show the rate advantages of dif- 
ferent transmission choices and illustrate the regimes 
where capacity is known for the Gaussian case. 



Paper Organization 

The paper is organized as follows: Sec. [2] introduces 
the considered channel model. In Sec [3] we intro- 
duce outer bounds to the capacity region, while inner 
bounds are presented in Sec. |H Sec. [5] contains the 
capacity results for the general channel model. Sec. [6] 
presents results for the Gaussian case. In Sec. [3 we 
introduce a series of numerical simulation of the re- 
sults presented in the paper. Sec. [8] concludes the 
paper. 
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2 Channel Model 

The Cognitive InterFerence Channel with a Com- 
mon Cognitive Message (CIFC-CCM), as shown in 
Fig. [TJ is obtained from the classical Cognitive In- 
terFerence Channel (CIFC) by having the primary 
receiver decode both messages. It consists of two 
transmitter-receiver pairs that exchange independent 
messages over a common channel. In the CIFC- 
CCM transmitter z, i G {1,2}, has input alphabet 
and its receiver has output alphabet 3^^. The 
channel is assumed to be memoryless with transi- 
tion probability Pyi,Y2\Xi,X2 so that PyuY2\XuX2 
dicates the memoryless extension to the channel tran- 
sition probability over N channel uses. Encoder 2 
wishes to communicate a message W2 uniformly dis- 
tributed on W2 = [1 : 2^^2] to decoder 2 in TV chan- 
nel uses at rate R2. Similarly, encoder 1, wishes to 
communicate a message Wi uniformly distributed on 
Wi = [1 : 2^^i] to both decoder 1 and decoder 2 
in N channel uses at rate Ri. Encoder 1 (i.e., the 
cognitive user) knows its own message Wi and the 
one of encoder 2 (i.e., the primary user), W2. A rate 
pair (i?i, i?2) is achievable if there exist sequences of 
encoding functions 



= ^2), fx- : Wi X W2 ^ 



N 



^2 = fx- {W2), fx- ■■ W2 ^ X^' , 
with corresponding sequences of decoding functions 



fw? ■■ y2 ^ 



N 



W2, 



such that 

lim Pr|^^?l^^?l^Iy|l ^ [1^1,^1,1^2]) = 0. 

N^oo I L J J 

The capacity region is defined as the closure of 
the union of achievable (i?i,i?2) pairs [17J. Stan- 
dard strong-typicality is assumed; properties may be 
found in p^. 

In the following we focus in particular on the Gaus- 
sian CIFC-CCM as depicted in Fig. El For this class 
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Figure 2: The Gaussian Cognitive Interference Chan- 
nel with Common Cognitive Message (Gaussian 
CIFC-CM). 

of channels, the input /output relationship is: 

Yi =Xi + aX2 + Zi, (la) 

^2 =X2 + |6|Xi+Z2, (lb) 

for a, 6 G C and for Zi ~ A/c(0, 1), where the A/c indi- 
cates complex, circularly symmetric jointly Gaussian 
Random Variables (RVs). Moreover, the channel in- 
puts are subject to the second moment constraints 



E 



<Pi, ie{l,2}. 



(2) 



A channel where the outputs are obtained from a 
linear combination of the inputs plus an additional 
complex Gaussian term can be reduced to the formu- 
lation in ^ and (j2j) without loss of generality [121 
App. A]. Note that the coefficient b can be taken to 
be real and positive without loss of generality, for this 
reason it will be indicated as \b\ in the remainder of 
the paper [12, App. A]. 

3 Outer Bounds 

In this section we develop three outer bounds to the 
capacity region: the first outer bound does not con- 
tain any auxiliary random RV, the second bound one 
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and the third bound three auxihary RVs. Addition- 
ally, each outer bound contains the previous bounds 
as a special cases but the increasing amount of aux- 
iliary RVs makes it harder to evaluate in closed form 
and compare to the inner bounds. 

The first outer bound for the capacity region of the 
general CIFC-CCM is based on results known for the 
cognitive interference channel in the "strong interfer- 
ence" regime. This outer bound contains no auxiliary 
RV and thus can be easily evaluated in closed form. 

Theorem 3.1. An Outer Bound for the CIFC- 
CCM 

Any achievable region for the CIFC-CCM is con- 
tained in the region 

Ri<I{YuX,\X2), (3a) 
Ri<I{Y2;X,\X2), (3b) 
i^i + i^2 </(l2;Xi,X2), (3c) 

union over all the joint distributions 

PxiX2PyiY2\Xi,X2' (4) 

Proof. The outer bound in (|3a|) was originally de- 
vised for the classical CIFC in [8 and is valid for the 
CIFC-CCM as well, since the cognitive decoder is de- 
coding only the cognitive message. The bound (|3bp 
is obtained from Fano's inequality as 

NRi -NcN 

= I{Yf;Wi\W2) 

= EtiH{Y2,k\Y,%,,W2.X2,k) 

-H{Y2MY2%i.WuW2,X,^k.X2,k) 

^ Zl/c=l H{Y2^k\X2,k) — H{Y2,k\Xi^k,X2^k) 

<NIiY2,Q;Xi,Q\X2,Q,Q), 

where Q is the time sharing RV, uniformly dis- 
tributed in the interval [1 : A/^]. 

The bound (|3c|) is derived in a similar fashion: 

N{Ri + R2) - Nen 
<I{Yi'-,Wt,W2) 
= Y.t,H{Y2,k\Y2%,) 

-H{Y2,k\Yi'^^+i,Wi,W2,Xi,k,X2,k) 

^ Z]fc=l ^0^2,k] Xi^k, X2,k) 

= NI{Y2,q;X^,q,X2,q\Q). 



All the bounds are decreasing in the time sharing 
RV Q and thus it can be dropped. □ 

Remark 3.2. The bound (|3b|) is redundant if 

/(Ai;yi|X2) </(Xi; 1^21X2), (5) 

for all the distributions Pxi ,X2 • Condition (|5]) corre- 
sponds to the condition describing the "strong inter- 
ference" regime for the CIFC. Thus, when dropping 
(|3b|) from the outer bound in Th. 13. li one obtains 
the "strong interference" outer bound for the CIFC 
[4J. This outer bound is capacity in the "very strong 
interference" regime for the general CIFC and is ca- 
pacity in the "primary decodes cognitive" regime for 
the Gaussian CIFC. 

Rem. [321 formally defines the relationship between 
the CIFC in "strong interference" and the CIFC- 
CCM. For a CIFC in the "strong interference" regime 
there is no loss of optimality in having the primary 
receiver decodes both messages. Under condition (j5j), 
the rate of the cognitive message is not bounded by 
the decoding capabilities of the primary receiver. For 
these reasons, the capacity of the CIFC is equiva- 
lent to the one of the CIFC-CCM when condition 
([5]) holds. We avoid referring to condition ^ as 
"strong interference" condition for the CIFC-CCM 
as one cannot properly define "interference" in this 
case since the primary receiver is decoding both the 
cognitive message and the primary message. 

Next, we derive an outer bound inspired by the 
outer bound in [8^ which is known to be tight for the 
CIFC in the "very weak interference" regime. 

Theorem 3.3. An Outer Bound for the CIFC- 
CCM with One RV 

Any achievable region for the CIFC-CCM is con- 
tained in the region 



Ri<I{Yi;Xi\X2), (6a) 

Ri<I{Y2;Xi\X2), (6b) 

R2<I{Y2;U,X2), (6c) 

Ri + R2< I{Y2 ■,U,X2) + I{Yi ; Xi I [/, X2) (6d) 

Ri + R2<I{Y2;X,,X2), (6e) 



union over all the joint distributions Pu,Xi,X2- 
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Proof. The bounds (j6aj), (j6b|) and (|6e|) are from 
Th. 13.11 The two bounds (|6c|) and (j6d|) are derived 
in [8] for the general CIFC and are also valid in the 
CIFC-CCM. □ 

Remark 3.4. The outer bound in Th. 13.11 can be ob- 
tained from the outer bound in Th. 13.31 by dropping 
(|6c|) and (|6dp . The region obtained by dropping these 
two bounds necessarily contains the region in ([6]) but 
the inclusion is not granted to be strict. 

Theorem 3.5. An Outer Bound for the CIFC- 
CCM with Three RVs 



Any achievable region for the CIFC-CCM is con- 



tained 


in the region 












Ri<I{Yi; 


Xl\X2), 






(7a) 




Ri<I{Y2; 


Xl\X2), 






(7b) 




Ri < I{Yi; 


V,Ui), 






(7c) 




Ri < I{Y2; 


v,u,), 






(7d) 




R2 < HY2; 


V,U2), 






(7e) 


Ri 


+ i?2 < I{Y2; 


X2\Ui,V)- 


^I{Yi; 


V^,f/i), 


(7f) 


Ri 


+ R2<I{Yr, 


Xi\U2,V)- 


VliY2; 


V,U2), 


(7g) 


Ri 


+ R2< IiY2; 


Xl,X2), 






(7h) 



union over all the joint distributions Pv,Ui,U2,Xi,X2 
that factor as 

Pui Pu2 Pv\Ui ,U2 Px2 1 U2vPxi I c/i , t/2 • (8) 

Proof. The bounds ([7al), ([7b]) and ([7hj) are from 
Th.O Bound ([7c]), ([lil), ([lf|) and ([7§ ar^ derived 
in [T9j for the general CIFC with a restriction to in- 
put distributions where X2 is a function of {U2-,V) 
and Xi is a function of {Ui^U2^V). Bound (|7d|) is in- 
duced by the common cognitive message and derived 
according to ([Tcj) in [19] . □ 

Remark 3.6. The factorization in ([HJ differs from the 
factorization in [19, Th. 4] and is, in general, more 
restrictive. The tightening of the factorization can 
be obtained by noting that the RVs Ui and U2 are 
associated with the messages Wi and W2 respectively. 

Remark 3.7. The outer bound in Th. 13.31 can be ob- 
tained from the outer bound in Th. l3.5l bv considering 
equations ([7a|) . ([7b]), ([7e|) . ( [Tg] ) and ()7hp and letting 



U = [^72,^]- The region obtained by dropping these 
five bounds necessarily contains the region in ([7]) but 
the inclusion is not granted to be strict. 

Corollary 3.8. BC-DMS Outer Bound Any 

achievable region for the CIFC-CCM is contained in 
the region 

Ri<I{YuU), (9a) 
Ri^R2< /(I2; Xi, X2I/7) + /(Fi; [/), (9b) 
i^l+i^2 </(l2;Xi,X2), (9c) 

union over all joint distributions Pu,Xi,X2- 

Proof. The outer bound in Cor. 13.81 can be obtained 
from the outer bound in Th. 13.51 bv considering only 
Equations ([7c]), ([Tfj), and ([Th]) and letting U = [V, Ui] 
andX = /72 = [Xi,X2]. □ 

Remark 3.9. The outer bound in Cor. 13.81 equals 
the capacity region of the general broadcast channel 
with degraded message set (BC-DMS) from [20 . If 
full transmitter cooperation is assumed in the CIFC- 
CCM, i.e., if the cognitive message is also known at 
transmitter 2, its capacity region equals the BC-DMS 
capacity. Note that this region gives an outer bound 
on the capacity region of the general CIFC in the 
strong interference regime, cf. (12) . 

4 Inner Bounds 

In this section we develop an inner bound for the 
CIFC-CCM that is obtained by a combination of ran- 
dom coding techniques such as rate-splitting, super- 
position coding and binning. The primary message 
is rate-split in three parts: a common part, a private 
part and a private part broadcasted by the cognitive 
transmitter to the primary receiver. The private pri- 
mary codeword is superposed to the private public 
one and the cognitive message is superposed over the 
common primary codeword and also binned against 
the primary private codeword. 

The achievable region can be obtained using stan- 
dard random coding techniques and is very much 
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reminiscent of the achievable region in [3]. We suc- 
cessively show that this region is also achievable by 
considering rate-sharing^ that is by allowing part of 
the cognitive message to be embedded into the pri- 
mary message and allowing part of the public mes- 
sages being integrated into the private ones. Finally, 
we provide a series of simple achievable regions con- 
taining at most one auxiliary RV. These regions have 
a simpler expression than the general inner bound 
and can thus be more easily compared to the avail- 
able outer bounds. Furthermore, they can be easily 
used for numerical simulations. 

Theorem 4.1. A General Inner Bound for the 
CIFC-CCM 

The following region is achievable for a general 
CIFC-CCM 

Ri < I{YuUic\U2c) - I{Uic;X2\U2c). (10a) 

Rl<I{Y2;Uic.U2pb\U2c.X2), (10b) 

Ri^R2< /(I2; U2c. X2, Ulc. U2pb). (10c) 

Rl^R2<I{Yv,Uic.U2c) 

^I{Y2;X2,U2pb\Uic.U2c). (lOd) 

2Ri^R2<I{Yi;Uic,U2c) 

^I{Y2',Uic.X2,U2pb\U2c) 

-I{Uic;X2\U2c). (lOe) 
for any distribution that factors as 

PUia,U2c,U2pb,Xi,X2- (11) 

Proof The achievable region in (p!Q|) is obtained in 
a similar manner than the region in [3 and using 
an identical notation. The message Wi is embed- 
ded in the codeword Uf^^ where c denotes "common" . 
As mentioned above, the message W2 is rate-split in 
three parts W2c^W2p and W2pb- W2c is the common 
part to be decoded by both receivers, W2p is the pri- 
vate part of W2 encoded by both transmitters while 
W2pb is the private part of the primary message trans- 
mitted by the cognitive transmitter. The rate-splits 
W2c and W2pb are embedded in the codewords 
and U2pi) while W2p is mapped directly in the chan- 
nel output X2 ' We then consider the achievable re- 
gion obtained by superposing the codewords and 



X2 over f/^^, by superposing [/^^ over all the other 
codewords and by binning U^^ against X2 - With 
this encoding scheme we achieve the region: 

Rlc>I(Uic.X2\U2c) 

R2c + Rlc + Rlc < I{Yi; U2c. Uic), (12a) 

Rlc^Rlc<I{Yi,Uic\U2c). (12b) 
R2C + Rlc + Rlc + R2p + R2pb ^ 

I{Y2; U2c, Uic, X2, U2pb) + I{Ulc; X2\U2c), (12c) 
Rlc + Rlc + R2p + R2pb ^ 

I{Y2; Uie,X2, U2pb\U2c) + I{Uie, X2\U2c), (12d) 

R2p + R2pb ^ 
1(^2; X2, U2pb\U2c, Uic) + I{Ulc] X2\U2c), (12e) 

Rlc + Rlc + R2pb ^ 
/(I2; C/lc, U2pb\U2c, X2) + I{Uie; X2\U2e), (12f) 
R2pb < I{Y2',U2pb\U2c,Ulc,X2)- 

(12g) 

The region in (fTQ|) is obtained from the Fourier- 
Motzkin elimination (FME), [21], of the region in ([H]) 
using the rate-splitting equation 

R2 = R2c + R2p + R2pb' (13) 

The region in (p!Q|) differs from the region in [3 in that 
there is no private cognitive message and in that there 
are additional constraints on the correct decoding of 
dit the primary receiver. □ 

The chain graph representation, [2?, of the achiev- 
able scheme in Th. 14.11 is provided in Fig [3l the 
boxes represent codewords associated with the pri- 
mary message while the diamond represents the cog- 
nitive message. Solid lines represent superposition 
coding and dotted lines binning. 

In the following we show that the region in Th. 14.11 
is also achievable by considering that part of the cog- 
nitive message can be embedded into the primary 
messages and part of the primary public message into 
the primary private ones. We refer to this technique 
as "rate-sharing" , in lack of any specific term used in 
literature. 

Rate-sharing was introduced by Hajek and Pursley 
[15 when deriving an achievable region for the broad- 
cast channel with common messages and successively 
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Figure 3: The chain graph representation of the 
achievable scheme in Th. 14. 1[ 

employed when in [16 to derive an achievable region 
for the relay broadcast channel. It consists in embed- 
ding part of a message after rate-splitting in another 
codeword: this can be done if rate is shifted from a 
common message to a private message and from the 
cognitive message to a primary message. 

Corollary 4.2. Rate-Sharing The region in 
Th. \4-l\ is also achieved by means of rate sharing. 

The proof of Cor. 14.21 is given in the Appendix [Al 

Remark 4.3. The region in ([TQ|) can also be derived 
with the approach in [12^ which is similar to the sim- 
plification of the Han and Kobayashi region for the 
interference channel in [27. In this approach, one 
needs to show that certain bounds obtained through 
the FME are redundant when considering the union 
over all the possible input distributions. The proof 
using rate-sharing is perhaps more laborious but is 
more powerful in that it does not require one to iden- 
tify the redundant bounds. 

We now provide two simpler sub-schemes that can 
be obtained by removing rate-splitting in the scheme 
of Th. SH 

Corollary 4.4. Achievable Region Applying 
only Superposition Coding 



The inner bound in Th. \4.1\ for R2p = R2pb = 
becomes 

Ri<I{Yi;Xi\X2), (14a) 
Ri<I{Y2;Xi\X2), (14b) 
Ri+R2<I{Yv,Xi,X2), (14c) 
Ri + R2<I{Y2;Xi,X2), (14d) 

for any distribution Pxi,X2- 

The achievable scheme in Cor. 14.41 employs only 
superposition coding and both messages are decoded 
at both receivers. 

Corollary 4.5. Achievable Region Applying 
only Binning 

The inner bound in Th. \4.1\ for i?2c = R2pb = 
becomes 

Ri<I{Yi;Uic)-I{Uic;X2), (15a) 
Ri<I{Y2;X^\X2), (15b) 
i^l+i^2 </(i2;Xi,X2), (15c) 
i^i + < /(l^i; Uic) + I{Y2;X2\Uic). (15d) 

for any distribution Pui^,Xi,X2- 

The achievable scheme in Cor. 14.51 employs only 
binning and the primary message is private. 

5 Capacity Results 

In this section we derive two capacity results for sub- 
sets of the general CIFC-CCM and capacity for the 
semi-deterministic CIFC-CCM. 

5.1 The Very Strong Interference 
Regime 

We begin by proving capacity in the "very strong in- 
terference" regime, a regime where there is no loss of 
optimality in having both receivers decode both mes- 
sages. This regime is reminiscent of the "very strong 
interference" regime for the IPC [9 and the CIFC 
[7 . There, the capacity of the channel reduces to the 
capacity of the compound Multiple Access Channel 
(MAC) obtained by considering the intersection of 
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the capacity region of the two MAC channels where 
each decoder decodes both messages. 

Theorem 5.1. Capacity in the "Very Strong 
Interference" Regime 

If 

/(r2;Xi,X2) </(yi;Xi,X2), (16) 

the region in (j3|) is capacity. 

Proof. Consider the achievable region in Cor. 14.41 
under condition ([16]) the rate bound (|14cp can be 
dropped and the resulting achievable region coincides 
with the outer bound in (|3|). □ 

Remark 5.2. The "very strong interference" regime 
for the CIFC is defined by condition (p!6|) and (j5j). 
However, condition (j5j) is not required to prove ca- 
pacity for the CIFC-CCM. 

Capacity in the "very strong interference" regime 
for the CIFC is achieved by having both receivers 
decode both messages and by superposing the cog- 
nitive message over the primary message [4 . This 
strategy achieves capacity for a class of CIFC-CCM 
that we also term "very strong interference" regime. 
This definition is not fully accurate since the primary 
receiver decodes both messages, but is coherent with 
the CIFC literature. 

5.2 The Primary Decodes Cognitive 
Regime 

The following result shows capacity for a class of 
channels in which binning allows full interference can- 
cellation at the cognitive decoder. This result is in- 
spired by the "primary decodes cognitive" capacity 
result available for the Gaussian CIFC [24] . 

Theorem 5.3. Capacity in the "Primary De- 
codes Cognitive" Regime 

If 

I{Yi;U)>I{Y2;U), (17a) 
I{U;X2\Y,) = (17b) 

for all the distributions Pu, Xi,X2 that factor as 

PuPx,Px,\u,x„ (18) 



the capacity for a CIFC-CCM is given by the region 
in ^ union over all the distributions Pxi,X2- 

Proof. Consider the scheme in (p!5]) . For a binning 
scheme with perfect interference cancellation where 
()17bp holds, the inner bound (|15ap achieves the first 
outer bound (|3a|) 

I{Yi;Ui,)-I{Uie;X2) 

= I{Yi; Uie, X2) - /(Fi; XalC/ie) - I{Uu; X2) 
= I{Y,; Uu\X2) + /(H; X2) - /(X2; Fi, /7ie) 

+ I{X2;Uie)-I{Uic;X2) 
= I{Yv,Uie\X2) - I{X2;Uic\Yi) 
= /(yi;Xi|X2). (19) 

The bound in ()15dp can be rewritten as: 

I{Yi;Uie) + I{Y2;X2\Uie) 
= I{Yi;Ui,) + I{Y2; X2, U^,) - 7(^2; Ut,) 
= I{Yi; Uic) + I{Y2; Xi, X2) - /(Fa; Uie) 
= I{Yi;Uie) + HY2; X2IX1) - /(Xa; C/ie), (20) 

while (jl5cp gives 

1(^2; Xi, X2) = 7(^2; Xi) + 7(^2; X2IX1) 

= /(>2; Uic) - /(X2; Uic) + /(I2; X2IX1). (21) 

This scheme achieves capacity if condition (|17ap holds 
since (|15dp is redundant in this case as it can be seen 
from Equations (|20]) and (|2l]). □ 

5.3 Capacity for the Semi- 
Deterministic Channel 

The semi-deterministic CIFC-CCM is a general 
CIFC-CCM where the channel output at the cogni- 
tive decoder is a deterministic function of the channel 
inputs, i.e., 

Yi = fYAXi,X2) (22) 

while the primary output is any random function of 
the inputs. When condition (|22]) holds, binning at the 
cognitive transmitter can fully pre-cancel the effect of 
the interference at the cognitive receiver thus making 
([3a|) achievable. 
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Theorem 5.4. Capacity of the Semi- 
Deterministic CIFC-CCM 

The capacity of the semi- deterministic channel is 

Ri<H{Yi\X2), (23a) 
Ri<I{Y2;Xi\X2), (23b) 
Ri + R2<I{Y2;X,,X2), (23c) 

union over all the distributions Pxi,X2- 

Proof. Consider the transmission scheme given in 
Cor. l4.5l to obtain the region (p!5]) . For the assignment 
Uic = 1^1, which is possible given (j22j), the bound 
()15dp is larger than (|15cp 

I{YuUic)^I{Y2;X2\Uic) 
= H{Yi) + H{Y2\Yi) + H{Y2\XuX2) 
= I{Y2;XuX2) ^ H{Yi\Y2) > I{Y2',Xi,X2) (24) 

and the inner bound in (p!5)) coincides with (|23|) which 
is also equivalent to the outer bound. □ 

Note that the result in Th. l5.4l does not require the 
fYi to be invertible as for the classical result for the 
deterministic IFC by El Gamal and Costa |25j . 

Corollary 5.5. Capacity of the Semi- 
Deterministic CIFC 

The region in ([23|) determines capacity also for a 
semi- deterministic CIFC in the ''strong interference^' 
regime. 

Proof. An outer bound for the CIFC in the "strong 
interference" regime is given by dropping (|3b|) from 
the outer bound in Th. 13.11 The remaining two 
bounds are given by (j23aj) and (j23cp in the semi- 
deterministic CIFC. In the "strong interference" 
regime of the CIFC defined by Condition ([5]) the 
bound given by (|23b[) is redundant. Thus, the 
scheme presented in (p!5]) also achieves capacity in the 
"strong interference" regime of the semi-deterministic 
CIFC. □ 

6 The Gaussian Channel 

We now specialize the results of the previous sections 
to the Gaussian channel in ([1]) and derive new capac- 
ity results for this channel model. In particular we 



prove capacity to within a constant gap of one bit 
and a factor two, thus providing a tight bound for 
the capacity region at both high and low SNR. 

6.1 Outer Bounds for the Gaussian 
Case 

Corollary 6.1. An Outer Bound for the Gaus- 
sian CIFC-CCM 

Any achievable region for the Caussian CIFC- 
CCM is contained in the region 

Ri < C(amin{l, |6p}Pi), (25a) 

Ri^R2< C{P2 + b^Pi + 2^ya\b\^PiP2), (25b) 

for C{x) = log(l + x) and a = 1 — a e [0, 1]. 

Proof. The outer bound is obtained from Th. 13.11 
by noting that complex, circularly symmetric chan- 
nel inputs maximize all the rate bounds simultane- 
ously. □ 

Corollary 6.2. BC-DMS-Based Outer Bound 
for the Gaussian CIFC-CCM 

Any achievable region for the Gaussian CIFC- 
CCM is contained in the region 

Ri < 

^/ aiPi + |apa2P2 + 2Re{a*pi}V^^T^ \ 

V 1 + aiPi + \a\^a2P2 + 2Re{a*p2} V^i2^y ' 

(26a) 

Ri^R2< 

^ f aiPi + |apa2P2 + 2Re{aVi}vW^ ^ 
V 1 + aiPi + \a\^a2P2 + 2Re{a*p2} Vc^i2Pi2 / 

+ C (ai\b\^Pi + a2P2 + 2Re{p2}V^IWP^) . 

(26b) 

Ri^R2< 

+ 2Re{piy'ai2 + P2 V<^i2}\/|^pPi2^ 

(26c) 

over the union over all (ai, 0^2, Pi, P2) satisfying 

(ai,a2, |pi|, \p2\) e [0, 1]"^ : |piV^ + P2V^| < 1, 

(27) 
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where P12 = PiP2,(^i2 = ol\ol2 and ol\2 = oliol2' 



The region 



Proof. The Gaussian BC-DMS-based outer bound is 
obtained from Cor. 13.81 as shown in [12^ App. D.B]. 

□ 



6.2 Inner Bounds for the Gaussian 
Case 

In the fohowing, the schemes given in Thm. 14. 1[ 
Cor. 14.41 and Cor. 14.51 are speciahzed to the Gaussian 
case. 



Corollary 6.3. Region Achievable Applying 
only Superposition Coding in the Gaussian 
CIFC-CCM 

The region 



Ri<C{aPi), (28a) 
Ri <C{a\b\^Pi) , (28b) 

Ri^R2<C (Pi + \afP2 + 2Re{a} VoA^) , 

(28c) 

Ri^R2<C (\bfPi + P2 + 2^a\b\^PiP2) , (28d) 

is achievable with the assignment of the RVs for the 
region in Th. 



Uic-^{0,aPi), 

U2c-^{0,P2), 

X2 = U2C1 

V ^2 



U2p^U 2pb 



(29a) 
(29b) 
(29c) 

(29d) 
(29e) 



Corollary 6.4. Region Achievable Applying 
only Binning in the Gaussian CIFC-CCM 



i?i < C (a|6pPi) , 
Ri^R2<C (|6|'Pi + P2 + 2^a\b\^PiP2 



(30a) 
(30b) 



Ri + R2<C (\b\^Pi + P2 + 2\/a|5|2PiP2) , (30d) 



for 



f{h,a^;\) 
I 



log 



cr^ + aPi 



and 



\^ ^ aPi + |/i|2P2+^2 



Acosta(^,Cr^) 



Acosta(^,^2) 



olPx 



aPi + Cr2 

is achievable with the assignment 

X, ^Ar(o,PO iG{i,2} 

U2c.U2pb = 9, 

Uic = Xi^XaX2. 



J 

(31a) 
(32) 



(33a) 
(33b) 
(33c) 



The achievable region in ([3Q|) reduces for A = and 
\b\ > 1 to 



Ri <C 
Ri + R2 <C 



aPi 



(v^ + aV^) +1, 
aPi 

(v^ + aV^)Vl^ 



(34a) 



Ri^R2<C (|6pPi + P2 + 2^ya\b\^P^P2 



(34b) 



(34c) 
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Proof. Consider the scheme in (|3Q]) with A = 

Note that for the region where §^ is a looser L^./^). The bounds §0^ and §^ are 

bound than (l34bD , the achievable scheme is similar to • ^ u V 2 y 

^ ^ given by 

the capacity achieving scheme in the Gaussian CIFC 

"weak interference" regime of [8 in which cognitive Ri < C (amin{l, |6|^}Pi) (37) 
and primary users are switched. 

in this case. 

^ ^ ^ .... 1 LL^T r-. . T This scheme achieves capacity when (l30cD is larger 

6.3 Capacity in the_"Very Strong In- ^j^^^ ^j^^ conditions in m hold. The 

terference Regime and the Pri- conditions were determined in [12 to prove the "pri- 
mary Decodes Cognitive" Regime mary decodes cognitive" regime^ for the Gaussian 

, , CIFC. □ 

The following corollary states the result of Th. 15.11 

for the Gaussian case in Remark 6.7. The "primary decodes cognitive regime" 

for the CIFC is defined by conditions ([36]) and con- 
Corollary 6.5. Capacity for the Gaussian ^iition (|5j) which is given by |6| > 1 in the Gaussian 
CIFC-CCM in the "Very Strong Interference" ^ase. Condition © is not required to prove capacity 
I^egime for the CIFC-CCM. Thus, the capacity of the Gaus- 
V sian CIFC-CCM for the regime with |6| < 1 is also 

^ given by Cor. 16.61 

(lap - 1)P2 -{\bf- l)Pi - 2|a - \b\\^/p[P2> 0, 

^^^^ 6.4 Capacity to Within a Constant 

the capacity of the Gaussian CIFC-CCM is given by Gap and a Constant Factor 

(ES)- Theorem 6.8. Capacity to within 1 bits/s/Hz 

^ ^ ^ T A k ^ ^ r A K r i ^'^V Gaussian CIFC-CCM, the outer bound re- 
Proof. Condition (1351) is derived from (1161) for the . . /rr^ t , i i-. / /tt 
^ . , , /rT\ -1 ^ r — 1 I 9'^^^ (125J) can be achieved to within 1 bits/ s/ Hz. 
Gaussian model m ((H). Details can be found m [12, 

App. B]. □ Proof. Consider the assignment 

The following corollary extends the "primary de- ~ A/'(0,Pi) i G {1,2}, (38a) 

codes cognitive" regime of ^12^ to the Gaussian CIFC- E\XiX2] = \/~olP\P2 (38b) 

CCM: ' ^ 

[/ic = Xi+aX2 + Ari, (38c) 

Corollary 6.6. The "Primary Decodes Cogni- ~A/^(0,(J^), (38d) 
tive Interference" Regime for the Gaussian 



CIFC-CCM for the scheme in (fT5]) . than we have 

// 

P2|l-a|&||^>(|&|^-l)(l + Pi + |a|^-P2) i?i < log((T2 + aPi) -GAPi(a), (39a) 

-PiP2|l-a|&||', (36a) i?i < C (a|6|2Pi) , (39b) 

P2|l-a|6||'>(|6|2-l)(l + Pi + |a|2p2 Pi + P2 < C (P2 + \\?Px\ + 2^o.\h\^PxP^ , (39c) 

+ 2Re{a}V^), (36b) + < C (^P2 + \b''Pi\ + 2y^b^K^^ 

then (HSl) is the capacity of the Gaussian CIFC-CCM. - GAP2(a), (39d) 
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where 



/(ri;/7ie)-/(/7ie,X2 
= -H{Ni- Ni\Xi 

= log (cr^ + aPi) - log I a 

= log {al^aPi) -GAPi(a) 



For any Gaussian CIFC-CCM, the outer hound re- 
gion in ([25|) can he achieved to within a factor 2. 

Proof. Capacity of the Gaussian CIFC-CCM is 
known for the regime with \h\ < 1. The achievability 
\ of the outer bound to within a factor 2 for \h\ > 1 
1 + VAR[Xi + aX2] / by a simple time division scheme is shown in [12 for 
Uq\ the Gaussian CIFC and can be directly applied to the 
Gaussian CIFC-CCM. □ 



= -H{Uic\Yi) 
aX2^Ni)^H{Xi 
VAR[Xi 



H{Uic\X2) 
■Ni\X2 
aX2 



and 



7 Numerical Simulations 



-GAP2(a) = /(Fi; Uic) - HUic.X^) 
-(/(l2;t/ie)-/(t/ic,X2)) 
= -H{Uic\Yi)^H{Uic\Y2) 

( , , VAR[Xi+aX2] ^ 
= -^^H"^^ l + VAR[X, + aX2] J 

+ i7(Xi+aX2 + 7Vi||6|Xi+X2+A^2) (41) 



Now fix cr^ = 1 to obtain the outer bound expres- 
sion. Clearly GAPi(a) > GAP2(a) and GAPi(a) < 
1. □ 



The result in Th. 16.81 also provides an alterna- 
tive proof to the constant gap in [11 where a con- 
stant additive gap between inner and outer bound 
is proved using an achievable scheme with a private 
cognitive message in the "strong interference" regime. 
As noted in [12 , in the "strong interference" regime 
for the Gaussian channel the primary decoder can 
reconstruct the channel output at the cognitive de- 
coder and thus decode the cognitive message. For 
this reason it is counterintuitive to consider a scheme 
with a private cognitive message to achieve the outer 
bound in the "strong interference" regime. Indeed 
the distance between inner and outer bound using 
the scheme in ([15]) is always smaller or equal to the 
distance using the scheme in [11]. Despite of this, 
the two schemes achieve the same gap from the Ri 
bound in the outer bound expression and thus the 
overall bound between inner and outer bound is the 
same in the two cases. 

Theorem 6.9. Capacity to within a Factor 2 



In the following we illustrate the results presented for 
the Gaussian CIFC-CCM in the previous section by 
means of numerical simulations. We begin by com- 
paring the outer bound in Cor. 16.11 with the outer 
bound in Cor. 16.21 in general it is not possible to 
simplify the expression in (|26|) and determine when 
it is tighter than (j25j). To determine the convex hull 
of (|26|) one needs to find the assignment of the pa- 
rameters in (f27|) that maximizes Ri + 11R2 for all 
ji G M^. This problem does not have a simple closed 
form solution apart from some special cases such as 
the degraded channel and the Z channel, in which 
a = [26j. Although a closed form solution cannot 
be determined, we can numerically simulate the outer 
bound in Cor. l6.2l and conclude that this outer bound 
is indeed tighter than Cor. 16.11 in a subspace of the 
parameter regime. This is illustrated in Fig. IH since 
the outer bound ([25]) does not depend on the channel 
parameter a, we fix the remaining channel parame- 
ters and plot the outer bound in (|27|) for increasing 
values of a. The analytical evaluation of the outer 
bound in ([27j) is quite involved and thus the results 
in the plot are obtained by an exhaustive search over 
the parameter space. From Fig. |4] we conclude that 
the tightest outer bound is obtained by considering 
the intersection of the outer bounds in Cor. 16.21 and 
Cor. 16.11 as one outer bound does not strictly include 
the other for all rate pairs. 

In Fig. [5] we compare outer and inner bounds for 
a specific Gaussian CIFC-CCM. In this regime the 
outer bound of Cor. 16.11 is tighter than the outer 
bound in Cor. 16.21 for all the Ri values in the in- 
terval [O...C(l + Pi)]. The figure also compares 
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Figure 4: Outer bounds for Gaussian CIFC-CCM Figure 5: Inner and outer bounds for Gaussian CIFC- 
with 6 = 2,Pi = P2 = 1 and a G [0.1,0.2,0.5,1]. CCM with a = 0.1, 6 = 4 and Pi = P2 = 1- 



the inner bound in Cor. 16.51 and the inner bound in 
Cor. 16.61 for the case of fuh interference cancehation 
and no interference cancehation. In the latter achiev- 
able scheme full interference cancellation is obtained 
with the choice 

^^^—^ <«' 

as defined in (|32]) while no interference cancellation 
is obtained with the choice A = 0. The choice 
A = Acosta maximizes the cognitive rate Ri and has 
been shown to achieve capacity in the "primary de- 
codes cognitive" regime of Th. 16.61 Interestingly the 
choice A = outperforms the choice A = Acosta in a 
large range of Ri which indicates that, in this par- 
ticular regime, having the primary receiver decode 
the cognitive codeword can be more easily performed 
when such codeword is not encoded against the inter- 
ference. The inner bound in Cor. 16.51 performs much 
worse than the other two schemes: in this achievable 
scheme both decoders are required to decode both 
codewords. Since the value of a we consider is fairly 
small (a = 0.1) having the cognitive receiver decode 
the primary codeword imposes strong restrictions on 
the rate R2 and this results in a drastic loss of per- 
formance. Note in particular that the point with the 
largest rate R2 achieved by this scheme is given by 

{RuR2)= Uc(\b\^/^^^^/^yy (43) 



This point is inferior to the point with the largest 
rate R2 achieved by the other schemes and the outer 
bound, i.e., 

i?2) = (0,C(|6pPi +P2 + . (44) 

This is because the bound in ()14cp is active and 
reduces the largest achievable sum rate. Despite of 
this, the scheme achieves capacity in the "very strong 
interference" regime of Cor. l6.5l where both the values 
of a and b are large with respect to the direct links. 

Next, we compare the inner bound given in Cor. 16.61 
with full interference cancellation that achieves ca- 
pacity in the "primary decodes cognitive" regime 
with the inner bound from Cor. 16.51 Fig. [6] depicts the 
achievable rates for different values of a and the other 
channel parameters are fixed. The parameters are 
chosen such that capacity is not known, i.e., the con- 
ditions for the "primary decodes cognitive" regime in 
(|36|) as well as for "very strong interference" regime in 
([35]) are not fulfilled. In such regime the scheme from 
Cor. 16.61 outperforms the scheme from Cor. 16.51 for 
small values of Ri . This is due to the fact that (|14cp 
is always active and thus, the maximum achievable 
rate R2 = C(|6pPi + P2 + 2v^6pA^) is achieved 
by the scheme from Cor. 16.61 and not achieved by 
Cor. 16.51 However, if both, a and a are increasing, 
the scheme from Cor. 16.51 exceeds the achievable rate 
region of Cor. 16.61 

In Fig. [71 the scheme from Th. [631 with = 1 
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Figure 6: Comparison of the achievable schemes in 
Cor.Oand Cor.[6S]for with 6 = 2 and Pi = P2 = 1. 
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Figure 7: Constant gap approximation for Gaussian 
CIFC-CCM with a = 2, 6 = 4 and P2 = 1. 

is ihustrated for different cognitive transmit powers 
Pi. This scheme is used to prove the constant ad- 
ditive gap in Th. 16.81 and thus approaches capacity 
for large SNR which, in the standard model of ([1]) 
means large transmit powers. The figure shows that 
the scheme from Th. 16.81 approaches capacity for in- 
creasing Pi and small cognitive rates R\. However, 
for large rates i?i, the gap between inner and outer 
bounds on the Pi coordinate, as given in (|39ap . ap- 
proaches 1 bit/s/Hz: 

lim GAPi(l)= lim log + — ^-^^f^^ 

Pi^oo ^ Pi^oo l + Pl + |a|2P2y 

= 1. (45) 
The inner bounds from Cor. 16.61 with full inter- 



Figure 8: Comparison of different schemes for Gaus- 
sian CIFC-CCM with a = 1, 6 = 1.5, Pi = 3 and 
P2 = l. 

ference cancellation, from Cor. 16.51 as well as from 
Th.ESlwith (j\ = 1 are compared in Fig.[8]in a regime 
in which capacity is still unknown. In the considered 
setup none of the approaches outperforms the others 
over the whole region. For Pi = the scheme from 
Cor. 16.61 touches the outer bound and thus, outper- 
forms both other schemes. The scheme from Th. 16.81 
can outperform the others only for medium rates Pi 
whereas the scheme from Cor. l6.5l is superior for large 
rates Pi. 

A plot of the capacity results available for the 
Gaussian CIFC-CCM is depicted in Fig.[9]for Pi = 10 
and P2 = 10: in the a x b plane we plot the "very 
strong interference" regime (area with circles) and 
the "primary decodes cognitive regime" (area with 
dots). 

8 Conclusion 

The paper studies a variation of the classical cog- 
nitive interference channel in which the primary re- 
ceiver decodes both messages. This channel is related 
to the cognitive interference channel in the "strong 
interference" regime and many results for the cog- 
nitive interference channel apply to the model un- 
der consideration. For this channel, we give outer 
bounds to the capacity region based with a different 
number of auxiliary random variable. A general in- 
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Figure 9: Capacity for Gaussian CIFC-CCM. 



ner bound, comprising rate splitting, superposition 
coding and binning is introduced. To prove capac- 
ity in special regimes, two simple sub-schemes, one 
using only superposition coding while the other ap- 
plies solely binning, are given. Using these schemes, 
we show capacity in the "very strong interference" 
regime, where there is no rate loss in having both re- 
ceivers decode both messages, as well as capacity in 
the "primary decodes cognitive" regime for discrete 
memory less channels. We also derive the capacity for 
the semi-deterministic case, where the cognitive out- 
put is a deterministic function of the channel inputs. 
Furthermore, we determine capacity for the Gaussian 
case to within a constant additive gap of one bit/s/Hz 
and to within a constant multiplicative factor of two. 



Acknowledgments 

The work of Stefano Rini was supported by the 
German Ministry of Education and Research in the 
framework of an Alexander von Humboldt Professor- 
ship. The work of Carolin Huppert was supported by 
the German research council "Deutsche Forschungs- 
gemeinschaft" (DFG) under Grant Hu 1835/3. 



References 

[1] A. Goldsmith, S.A. Jafar, I. Marie, and S. Srini- 
vasa. Breaking spectrum gridlock with cogni- 
tive radios: An information theoretic perspec- 
tive. Proceedings of the IEEE, 97(5):894-914, 
2009. 

[2] N. Devroye, P. Mitran, and V. Tarokh. Achiev- 
able rates in cognitive radio channels. IEEE 
Trans. Inf. Theory, 52(5):1813-1827, May 2006. 

[3] S. Rini, D. Tuninetti, and N. Devroye. State of 
the cognitive interference channel: a new unified 
inner bound. In Proc. of the Int. Zurich Seminar 
on Comm., March 2010. 

[4] I. Marie, RD Yates, and G. Kramer. The ca- 
pacity region of the strong interference channel 
with common information. In Proc. Asilomar 
Conferenece on Signal, Systems and Computers, 
pages 1737-1741, Nov. 2005. 

[5] Chandra Nair and Abbas El Gamal. An outer 
bound to the capacity region of the broadcast 
channel. IEEE Trans. Inf. Theory, 53(1) :350- 
355, Jan. 2007. 

[6] S. Rini, D. Tuninetti, and N. Devroye. New in- 
ner and outer bounds for the memoryless cogni- 
tive interference channel and some new capacity 
results. IEEE Trans. Inf. Theory, 57(7):4087 - 
4109, July 2011. 

[7] I. Marie, R. Yates, and G. Kramer. The strong 
interference channel with unidirectional cooper- 
ation. In Proc. U CSD Workshop on Information 
Theory and Applications, February 2006. 

[8] W. Wu, S. Vishwanath, and A. Arapostathis. 
Capacity of a class of cognitive radio channels: 
Interference channels with degraded message 
sets. IEEE Trans. Inf. Theory, 53(11):4391- 
4399, Nov. 2007. 

[9] H. Sato. The capacity of Gaussian interference 
channel under strong interference. IEEE Trans. 
Inf. Theory, IT-27(6):786-788, November 1981. 



16 



[10] M. Costa and Abbas El Gamal. The capacity 
region of the discrete memoryless interference 
channel with strong interference. IEEE Trans. 
Inf. Theory, 33(5):710-711, 1987. 

[11] S. Rini, D. Tuninetti, and N. Devroye. The ca- 
pacity of the semi-deterministic cognitive inter- 
ference channel and its application to constant 
gap results for the Gaussian channel. In Proc. 
IEEE Int. Conf. Commun., June 2011. 

[12] S. Rini, D. Tuninetti, and N. Devroye. Inner and 
outer bounds for the Gaussian cognitive inter- 
ference channel and new capacity results. IEEE 
Trans. Inf. Theory, 58(2) :820 - 848, February 
2012. 

[13] S.I. Gel'fand and M.S. Pinsker. Coding for chan- 
nel with random parameters. Problems of control 
and information theory, 9(1): 19-31, 1980. 

[14] Y. Liang, A. Somekh-Baruch, H.V. Poor, 
S. Shamai, and S. Verdu. Capacity of cognitive 
interference channels with and without secrecy. 
IEEE Trans. Inf. Theory, 55(2):604-619, 2009. 

[15] B. Hajek and M. Pursley. Evaluation of an 
achievable rate region for the broadcast chan- 
nel. Information Theory, IEEE Transactions on, 
25(l):36-46, 1979. 

[16] Y. Liang and G. Kramer. Rate regions for relay 
broadcast channels. IEEE Trans. Inf. Theory, 
53(10):3517-3535, 2007. 

[17] T.M. Cover and J.A. Thomas. Elements of 
Information Theory. Wiley-Inter science. New 
York, 1991. 

[18] Gerhard Kramer. Topics in Multi-User Informa- 
tion Theory. Foundations and Trends in Com- 
munications and Information Theory. Vol. 4: No 
45, pp 265-444, 2008. 

[19] I. Marie, A. Goldsmith, G. Kramer, and 
S. Shamai. On the capacity of interference chan- 
nels with one cooperating transmitter. IEEE 
Trans. Inf. Theory, 19(4):405-420, April 2008. 



[20] J. Korner and K. Marton. General broadcast 
channels with degraded message sets. IEEE 
Trans. Inf. Theory, 23(l):60-64, Jan 1977. 

[21] S. Lall. Advanced topics in computation for con- 
trol. Lecture Notes for Engr210b at Stanford 
University, Stanford, CA, 2005. 

[22] S. Rini. An achievable region for a general 
multi-terminal network and the corresponding 
chain graph representation. Arxiv preprint 
arXiv:1112.1497, 2011. 

[23] H.F. Chong, M. Motani, H.K. Garg, and 
A. El Gamal. On the han-kobayashi region for 
theinterference channel. IEEE Trans. Inf. The- 
ory, 54(7):3188-3195, 2008. 

[24] Stefano Rini, Daniela Tuninetti, and Natasha 
Devroye. New results on the capacity of the 
Gaussian cognitive interference channel. In Proc. 
Allerton Conf. Commun., Control and Comp., 
September 2010. 

[25] A. El Gamal and M. Costa. The capacity region 
of a class of deterministic interference channels. 
IEEE Trans. Inf. Theory, 28(2):343-346, March 
1982. 

[26] Stefano Rini, Daniela Tuninetti, and Natasha 
Devroye. A new capacity result for the Z- 
Gaussian cognitive interference channel. In Proc. 
IEEE Int. Symp. Inf. Theory, August 2011. 

A Proof of Corollary 14.21 

To make the notation more compact we employ in 
the following the short-hand notation 

Iy, = I{Yi ; U2c, Uie) - I{Uie; X2\U2c), (46a) 
= liYi; Uu\U2c) - IiUic;X2\U2c), (46b) 
Iy, = I{Y2; U2c, Uie, X2, U2pb), (46c) 

Iy2\U,. = HY2; f/lc, X2, U2pb\U2c), (46d) 
^Y2\U2c,Uic = IiY2; X2,U2pb\U2cjUic) 

+ IiUic;X2\U2c), (46e) 
Iymu2.,X2 = I{Y2; Uu, U2pb\U2c, X2), (46f) 

Iy,\U2.,U,.,X2 = I{Y2; U2pb\U2c, Ui„X2). (46g) 
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Consider the proof of Th. 14.11 and note that if the 
rate vector [R2c-,Ric-, R2p-,R2ph^ is achievable, then 
also the rate vector (i^2c, ^ic, ^2p, ^2^5), with 



R2c 


= R2c - 


A (2) 
^2p 


^2pb 


^ ^2c ' 


(47a) 


Ric 


= Ric - 


a(i) 

^2p 


^2pb 


_ a(1) 
^2c ' 


(47b) 




R2p - 


= R2p 


^ ^2p 


^ ^2p ' 


(47c) 




R2pb = 


R2pb - 


^ ^2pb 




(47d) 



FME of all the As to obtain a compact representation 
of the achievable region only in terms of i?2c, Ric^ R2p 
and R2b' First of all note that A^J always decreases 
the upper rate bounds in (j39|). This implies that 
the largest achievable region is obtained by simply 
setting A^^^^ = 0. The FME of all the remaining As is 
algorithmically complex: for this reason we proceed 
in eliminating As is successive steps. We begin by 
eliminating A2'J which yields the region 



is achievable as long as the latter rates i?2c, Ric^ ^2p, 
R2pb are still positive, that is as long as 



R2c > 



^2pb 



^2c ' 

Ric > ^2« + ^2r)h + ^2c ' 



(48a) 
(48b) 



^2p ~ ^2pb 

as shown in [TF and [IF. 

The above implies that the achievability of the re- 
gion in (p!2]) also implies the achievability of the region 



R2C1 Rlci R2p^ R2pb ^ 0, 

>0, 



2p •> ^2pb'> 

R2p > A^^^ 



2pb 



R2pb > A 



(1) 
2pb 



^(2) 
^2pb 



R2C1 Rlci R2p^ R2pb ^ 0, 


(49a) 


R2pb 


a(1) , A (2) ^ r , 

~ ^2pb + ^2pb ^ ^^2|f/2c,t/lc,X2^ 


^(2) ^(2) ^(1) ^(1) ^(1) 


(49b) 


Ric - 


A (1) A (2) . J 

^ ^2pb ~ ^2pb ^ ^Yi\U2c^ 


R2c^AfJ^ 


A (2) > A (1) 

" ^2pb ^ ^2c ' 


(49c) 


Ric - 


\- R2pb - A2^5 < Iy2\U2c,X2^ 


R2p > A^^^ - 


^ ^2p 


(49d) 


Ric - 


h i?2p + R2pb - ^fp - ^fpb 


R2pb > A^^J^ 


+ A^'^ 

^ ^2p6 


(49e) 


< 


min {/Y2|f/2c'^yi|t/2c + ^^2|f/2c,t/lc} ' 


R2c + Ric + 


^(2) ^(2) ^(1) ^(1) , 


Ric - 


h i?2p + 2i?2p6 - A^^^ - 2Af^^ - A^^^^ 






(49f) 


^ ^Y2\U2c,X2 +^y2|t/2c,t/lc' 




a(1) , a(1) < T , 


(49g) 


Ric - 


hi?2c + Ag)+Agi + A^;i</^„ 


R2C + Ric + 


^2p + R2pb < ^Y2\U2c,Ui,^ 


(49h) 


Ric - 


h R2c + ^2p + ^2p6 


Ric + R2p + 


p ^ a(^) a(2) a(2) < 7^ , 

H2pb + - /\2p - ^2pb ^ ^V2|t/2c' 


< 


VCn.n[lY2,lYr + ^Y2|f/2c,f/ic} ' 






(49i) 






R2p + R2pb ~ 


^2p ^2pb ^2p ^2pb 








^ ^Y2\U2c,Uia + ^(^lc;^2^2c), 


(49j) 






Ric + R2pb -\ 


a(1) , a(1) a (2) / r , 
- l\2c + ^2p - ^2pb ^ ^Y2\U2o,X2 


(49k) 






R2pb - A^^J^ 


~ ^2pb ^ ^"5^2|t/2c,t/ic,X2 5 


(491) 







(50a) 
(50b) 
(50c) 
(50d) 
(50e) 
(50f) 
(50g) 

(50h) 

(50i) 
(50j) 

(50k) 



where (|49cj) , (|49dj) and (|49ej) result from the condition 
R2c-,Ric-,R2p-,R2pb ^ 0. We now proceed with the 



f2) 

In the next steps we first eliminate A^^ and succes- 
sively A^2pb ^2p6 again by means of FME which 
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gives 



R2C1 Rlc^ R2p^ R2pb ^ O7 (51a) 
Ric < min{/y^|f/,^,/y2|t/2„X2} (51b) 
Ric^R2c < Iy,. (51c) 

Rlc + R2c + R2pb < IYi + Iy2\U2c,Ui,,X2^ (51d) 

^ic + R2c + + ^2p6 < min {IY2JY1 + ^y2|t/2c,t/ic} 

(51e) 

2Ric + i?2c + R2pb < ^Yi + ^Y2|t/2c,^2' 

(51f) 

2Ric + i^2c + R2p + ^2p6 < ^Yi + ^Y2\U2c- (^^g) 

From the FME of R2 in (j5l]) and ([l3]) we finally 
obtain the achievable rate region (p^Oj) . This concludes 
the proof. 
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